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mendations  for  official  action  normally  are  conveyed  to  appropriate  military 
agencies  by  briefing  or  Disposition  Form. 


FOREWORD 


The  Simulation  Systems  Technical  Area  of  the  Army  Research  Institute 
for  the  Behavioral  and  Social  Sciences  (ARI)  performs  research  and  develop¬ 
ment  in  areas  that  include  training  simulation  with  applicability  to  mili¬ 
tary  training.  Of  special  interest  is  research  in  the  area  of  simulation 
fidelity  requirements.  It  is  necessary  to  determine  the  necessary  levels 
of  simulator  fidelity  before  any  training  system  may  be  developed  and  pro¬ 
cured  for  use  in  the  Army  training  community. 

This  report  surveys  the  relevant  literature  on  simulator  fidelity  and 
recommends  a  workable  definition  of  simulator  fidelity  as  well  as  outlin¬ 
ing  an  approach  to  the  empirical  determination  of  simulator  fidelity 
requirements . 

This  report  is  responsive  to  the  requirement  of  the  Office  of  the  Proj¬ 
ect  Manager  for  Training  Devices  (PM  TRADE)  and  to  the  Army's  Project 
2Q162 717A790 ,  "Defining  Simulation  Fidelity  Requirements." 


JOSEPH  Z^ID^ER 
s8«sJ:hnical  Director 
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BRIEF 


Requirement : 

To  review  the  relevant  literature  on  simulator  fidelity  in  order  to  de¬ 
termine  how  the  term  fidelity  has  been  used.  From  this  review,  to  recommend 
a  workable  definition  of  fidelity  and  outline  a  course  of  empirical  investi¬ 
gation  to  determine  the  necessary  levels  of  simulator  fidelity  to  insure 
adequate  training  effectiveness. 


Procedure : 

An  extensive  review  of  literature  on  simulator  fidelity  was  conducted. 

It  was  shown  that  there  is  much  confusion  in  the  usage  of  the  term  "fidelity." 
A  two- aspect  defiviition  of  fidelity  was  proposed  which  focuses  on  the  physi¬ 
cal  and  functional  similarity  of  the  training  device  to  the  actual  equipment 
for  which  training  is  undertaken.  This  definition  is  discussed  as  it  applies 
to  several  parameters  or  the  training  situation,  such  as  type  of  task,  train¬ 
ee's  stage  of  learning,  or  total  training  context,  to  determine  training  ef¬ 
fectiveness.  Methodological  issues  in  the  empirical  determination  of  fidelity 
requirements  arc  discussed  ar.d  a  pilot  research  strategy  is  outlined. 


Findings : 

Confusion  surrounding  the  use  of  the  term  "fidelity"  may  be  substantially 
reduced  if  we  limit  the  use  of  the  term  and  let  fidelity  refer  only  to  the 
degree  of  similarity,  both  physical  and  functional,  between  a  training  device 
and  the  actual  equipment  for  which  the  training  was  undertaken. 


Utilization  of  Findings: 

This  report  can  be  used  by  researchers  in  determining  how  they  may  de¬ 
sign  empirical  studies  to  determine  necessary  levels  of  simulator  fidelity 
and  by  the  military  training  community  to  determine  the  nature  of  training 
devices,  which  must  be  designed  and  procured. 
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SIMULATOR  FIDELITY:  A  CONCEPT  PAPER 


Today's  Army  is  faced  with  training  problems  like  none  previously  en¬ 
countered  in  that  the  high  technology  of  its  advanced  weapons  systems  re¬ 
quires  correspondingly  sophisticated  operators  and  maintainers.  This  re¬ 
quirement  places  a  heavy  burden  on  training,  particularly  given  the 
prevalence  of  large  numbers  of  Category  IV  enlistees.  The  traditional 
approach  of  training  personnel  on  actual  equipment  is  becoming  more  and 
more  prohibitive  because  of  the  cost  of  these  systems.  To  cope  with  this 
prohibitive  expense  and  to  improve  the  effectiveness  of  its  training,  the 
Army  has  and  will  continue  to  turn  increasingly  toward  the  use  of  simu¬ 
lators.  This  movement  is  being  paralleled  by  the.  other  aj.med  services 
(Miller,  1974;  Spangenberg,  1976;  Fink  &  Shriver ,  1978;  Purifoy  &  Benson, 
1979;  Malec,  1980).  Apart  from  potential  cost  savings,  simulators  have 
several  unique  instructional  advantages  over  the  use  of  either  the  class¬ 
room  or  actual  equipment  for  training. 

Spangenberg  (1976)  discusses  seven  unique  advantages  of  simulation  for 
training.  Simulators  can  (1)  provide  immediate  feedback,  (2)  increase  the 
number  of  crises,  conflicts,  equipment  malfunctions,  and  emergencies  to  pro¬ 
vide  the  trainee  with  experience  which  would  be  unavailable  on  actual  equip¬ 
ment,  (3)  compress  time  so  a  complex  sequence  of  tasks  may  be  accomplished 
in  the  time  it  would  take  to  run  through  only  one  or  two  tasks  on  the  actual 
equipment,  (4)  vary  the  sequence  of  tasks  to  maximize  training  efficiency, 

(5)  provide  guidance  and  stimulus  support  to  the  trainee  in  the  form  of 
prompts  and  feedback,  (6)  vary  the  difficulty  level  to  match  the  skill  level 
of  each  individual  trainee,  and  (7)  provide  the  trainee  with  an  overview 
from  which  the  trainee  may  form  an  overall  understanding  of  the  whole  situ¬ 
ation.  These  advantages,  in  addition  to  their  potential  cost-effectiveness 
have  led  the  Army  (PM  TRADE)  to  the  conclusion  that  simulators  should  be 
utilized  to  greater  advantage  in  its  training  program. 

But  though  they  are  intended  to  reduce  training  costs ,  training  simu¬ 
lators  may  not  be  cost  effective  if  they  duplicate  the  physical  and  func¬ 
tional  characteristics  of  operational  equipment  more  precisely  than  is  re¬ 
quired  for  effective  transfer  of  training,  i.e.,  if  simulation  fidelity 
exceeds  training  requirements.  However,  designing  the  appropriate  level 
of  fidelity  is  not  an  easy  task.  At  the  very  least,  a  set  of  consistently 
used  operational  definitions  of  fidelity  is  required.  The  term  fidelity 
has  been  used  with. a  variety  of  meanings  and  it  is  vital  that  we -agree  on 
a  workable  definition  if  we  are  to  develop  user-oriented  guidance  in  the 
design,  acquisition,  and  deployment  of  training  simulators.  This  paper 
attempts  to  develop  such  a  definition  of  fidelity  by  reviewing  and  synthe¬ 
sizing  the  relevant  literature.  The  paper  then  attempts  to  place  the  con¬ 
cept  in  the  proper  context  of  the  Army's  training  needs.  Finally,  it  out¬ 
lines  a  variety  of  strategies  for  implementing  further  research  to  determine 
specific  fidelity  requirements  for  the  wide  range  of  tasks  carried  out  by 
the  modern  Army. 
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DEFINITIONS  OF  FIDELITY 

The  literature  on  simulation  for  training  discusses  the  problem  of  the 
necessary  levels  of  fidelity  in  simulators.  The  concept  of  fidelity  is 
unclear  because  it  has  been  used  in  a  wide  variety  of  ways  with  a  wide 
variety  of  meanings.  This  section  surveys  the  relevant  literature  and  de¬ 
lineates  the  most  widely  used  definitions  of  fidelity.  Some  definitions 
are  very  general  while  others  tend  to  be  more  specific. 

General  Approaches  to  the  Definition  of  Fidelity 

Several  recent  discussions  of  training  simulation  have  taken  a  general 
approach  to  the  definition  of  fidelity.  Two  instances  will  serve  as  ex¬ 
emplars  of  this  approach.  Miller  (1974)  states  that  fidelity  refers  to  the 
accuracy  of  reproduction  of  the  actual  equipment  by  the  simulator;  it  is  the 
degree  to  which  a  simulator  resembles  the.  real  operational  equipment  or 
situation.  An  even  more  general  approach  is  taken  by  Malec  (1980).  He 
states  tnat  fidelity  has  been  achieved  if  acLi'-ity  on  the  simulator  is  "suf¬ 
ficiently  like  exercising  the  actual  equipment"  (Maiec,  1980,  p.  16) . 

Neither  of  these  definitions  is  sufficiently  precise  or  operational  to  be 
useful  in  the  development  of  guidance  for  simulator  designers.  We  must 
know  what  "similar"  means  or  what  to  be  "sufficiently  like"  the  actual 
equipment  entails.  There  have  been  other  definitions  of  fidelity  which 
are  much  more  specific  than  those  above. 

Specific  Breakdowns  of  Fidelity 

One  of  the  most  frequently  cited  breakdowns  of  the  concept  of  fidelity 
was  provided  by  Kinkade  and  Wheaton  (1972) .  They  detail  three  types  of 
fidelity:  equipment,  environmental,  and  psychological. 

•  Equipment  fidelity  is  the  degree  to  which  the  simulator  duplicates 
the.  appearance  and  "feel"  of  the  operational  equipment. 

•  Envi7;onmental  fidelity  is  the  degree  to  which  the  simulator  dupli¬ 
cates  the  sensory  stimulation  (excluding  control  feel)  which  is 
received  from  the  task  situation. 

•  Psychological  fidelity  is  the  degree  to  which  the  simulator  is 
perceived  by  the  trainee  as  being  a  duplicate  of  the  operational 
equipment  and  the  task  situation. 

(Kinkade  &  Wheaton,  1972,  p.  679) 

Kir.kade  and  Wheaton  provide  examples  of  each  of  these  types  of  fidelity. 
Equipment  fidelity  would  be  high  for  a  driver  trainer  designed  to  teach 
driving  if  "an  actual  automobile  cab,  with  steering  wheel,  steering  wheel 
feedback  dynamics,  speedometer,  fuel  gauge,  etc."  (Kinkade  &  Whe.  ..on , 

1972,  p.  679)  were  included.  Environmental  fidelity  would  be  high  if  the 
trainer  provided  "motion  cues  and  a  three-dimensional,  dynamic  visual  pre¬ 
sentation  of  the  external  world  (i.e.,  the  road,  trees,  sky,  etc.)" 
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(Kinkacie  &  Wheaton,  1972,  p.  679) .  Finally,  the  level  of  psychological 
fidelity  would  be  high  if  the  trainee  perceives  the  simulator  as  being 
highly  realistic,  even  though  it  might  deviate  substantially  from  the 
actual  equipment  it  is  supposed  to  represent.  These  three  types  of  fi¬ 
delity  do  not  cover  all  aspects  of  the  concept. 

A  series  of  four  papers  (Wheaton,  Mirabella,  &  Farina,  1971;  Wheaton 
&  Mirabella,  1972;  Mirabella  &  Wheaton,  1974;  Prophet  &  Boyd,  1970)  dis¬ 
cuss  task  fidelity.  Task  fidelity  refers  to  the  correspondence  between 
tasks  performed  on  the  actual  equipment  and  tasks  performed  on  the  train¬ 
ing  simulator.  A  similar  behavioral  approach  to  fidelity  is  taken  by 
Matheny  (1978) .  We  thus  have  four  facets  to  the  concept  of  fidelity  so 
far.  One  facet  deals  with  the  physical  configuration  of  the  simulator 
(equipment  fidelity) ,  one  deals  with  the  total  context  which  the  simula¬ 
tor  tries  to  duplicate  (environmental  fidelity) ,  one  takes  a  perceptual 
viewpoint  (psychological  fidelity) ,  and  finally  we  have  a  behavioral  ap¬ 
proach  (task  or  behavioral  fidelity) .  Some  approaches  do  not  break  the 
concept  of  fidelity  down  quite  so  much. 

Fink  and  Shriver  (1978)  discuss  only  two  types  of  fidelity — functional 
and  physical  fidelity.  Functional  fidelity  is  the  attempt  to  represent 
faithfully  the  stimulus  and  response  options  provided  by  all  or  portions  of 
a  piece  of  equipment.  The  previous  example  of  the  motion  and  visual  cues  in 
a  driver  trainer  would  also  be  an  example  of  functional  fidelity.  Physi¬ 
cal  fidelity  is  the  attempt  to  represent  accurately  the  appearance  and 
"feel"  of  the  actual  equipment.  The  example  of  the  parts  included  in  the 
driver  trainer  is  also  an  example  of  physical  fidelity.  Fink  and  Shriver' s 
designations  of  functional  and  physical  fidelity  correspond  to  Kinkade  and 
Wheaton's  designations  of  environmental  and  equipment  fidelity  respectively. 
The  term  "psychological  fidelity"  is  not  used  by  Fink  and  Shriver.  This 
may  be  because  they  consider  it  a  function  of  the  other  two  types  of 
fidelity. 

Slenker  and  Cream  (1977)  not  only  leave  out  psychological  fidelity  but 
physical  fidelity  as  well.  They  discuss  only  functional  fidelity.  This 
they  define  as  the  attempt  to  duplicate  all  of  the  stimulus  conditions  of 
the  actual  equipment.  They  apparently  consider  functional  fidelity  to  en¬ 
compass  physical  fidelity.  This  approach  would  therefore  be  guided  by  pre¬ 
cise  stimulus  analysis  to  ensure  that  the  simulator  provided  the  same  cues 
as  provided  by  the  actual  equipment. 

Freda  (1979)  defines  fidelity  as  having  two  aspects.  Physical  fidelity 
is  the  "engineering  (hardware)  representation  of  features  in  the  operational 
equipment"  and  psychological  fidelity  to  the  "behavioral  (functional)  repre¬ 
sentation  of  the  information  processing  demands  of  the  operational  equip¬ 
ment"  (Freda,  1973,  p.  2) .  This  approach  approximates  that  of  Fink  and 
Shriver  (1978).  Freda's  physical  fidelity  agrees  with  physical  fidelity, 
as  defined  by  Fink  and  Shriver.  Freda's  psychological  fidelity  is  very 
close  to  Fink  and  Shriver ‘s  functional  fidelity.  Any  differences  between 
these  two  approaches  are  those  of  emphasi-j.  Freda  appears  to  focus  more 
closely  on  the  trainee  through  tJv»  behavioral  aspects  of  "psychological' 
fidelity  while  Fink  and  Shriver  focus  on  the  hardware  through  the  stimulus 
and  response  aspects  of  "functional"  fidelity.  Since  one  may  define 
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behavior  ad  stimuli  and  responses,  it  is  not  difficult  to  see  the  parallel 
between  these  two  approaches. 

It  can  be  easily  seen  that  ohe  term  fidelity  has  been  used  in  a  variety 
of  contexts.  Hardware,  environmental,  perceptual,  and  behavioral  applica¬ 
tions  of  the  term  fidelity  tend  to  obscure  one's  understanding  of  the  term. 

In  addition,  different  "types"  of  fidelity  are  used  to  label  the  same  con¬ 
cept,  such  as  equipment  and  physical  fidelity  or  environmental  and  functional 
fidelity.  The  application  of  the  term  "fidelity"  in  so  many  contexts  and  in 
so  many  variations  constitutes  an  overextension  of  the  term  and  negates  the 
usefulness  of  the  concept.  We  need  more  consistency  and  clarity  in  our 
definitions  of  fidelity  concepts  if  they  acre  to  be  useful  in  the  design  of 
training  simulators.  Perhaps  fidelity  concepts  have  been  developed  too 
academically  and  our  efforts  should  be  directed  to  other  areas  that  sure 
oriented  r-ore  toward  applications. 

Often  it  is  possible  to  gain  greater  understanding  of  a  concept  if  we 
study  the  way  it  is  used  by  practitioners  as  opposed  to  researchers.  In 
other  words,  let  us  now  change  the  direction  of  our  focus  from  the  academic 
side  to  the  more  pragmatic  approach  taken  by  contractors  who  actually  at¬ 
tempt  to  build  simulators  and  by  the  armed  services  which  attempt  to  pro¬ 
vide  user  guidance  in  evaluating  and  procuring  the  devices  that  the  con¬ 
tractors  build. 

Simulator  developers  have  not  been  much  more  successful  in  consistently 
conceptualizing  fidelity.  Consider  for  example  the  work  of  four  potential 
contractors  who  submitted  designs  for  a  proposed  maintenance  training  simu¬ 
lator,  the  Army  Maintenance  Training  and  Evaluation  Simulation  System 
(AMTESS) . 

Hughes  Aircraft  Corporation  (1980)  takes  a  two-factor  approach  to  the 
definition  of  fidelity.  They  define  physical  fidelity  as  the  degree  of 
realism  presented  in  every  sensory  mode.  This  seems  to  be  a  combination  of 
both  of  Fink  and  Shriver's  distinctions,  physical  and  functional  fidelity. 
Realism  of  simulator  controls  as  well  as  realism  in  the  way  the  controls 
are  displayed  and  the  total  environment  in  which  the  simulator  is  used 
would  be  indicat  r«*  of  physical  fidelity,  as  the  term  is  used  by  Hughes. 
Hughes  also  uses  the  term  "psychological  fidelity"  in  a  new  sense.  It  is 
defined  as  how  fully  the  training  environment  exercises  the  mental  skills 
required  in  performing  the  job  tasks.  Other  distinctions  of  fidelity  are 
also  made,  such  as  behavioral  fidelity,  engineering  fidelity,  and  equipment 
fidelity,  but  it  is  not  clear  (at  least  to  this  reviewer)  how  these  terms 
are  used  by  Hughes. 

Seville  Research  Corporation  (1980)  defines  fidelity  as  the  details  of 
the  characteristics  of  the  equipment  or  item  which  are  represented  in  the 
simulation  and  the  "mode"  in  which  those  details  are  represented,  and  which 
are  specifically  included  for  training  purposes.  This  approach  analyzes 
fidelity  in  terms  of  the  entire  training  context.  The  equipment  charac¬ 
teristics  may  need  to  be  modified  to  deal  with  different  tasks  or  stages 
in  the  training  process.  They  emphasize,  however,  that  the  question  of 
fidelity  only  concerns  those  characteristics  which  need  to  be  included  to 
enhance  training  effectiveness  and  not  those  related  to  maintainability, 
reliability,  or  cost. 
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Grumman  Aerospace  Corporation  (1980)  does  not  specifically  define 
fidelity.  They  do  allude  to  its  definition  by  stating  that  fidelity  re¬ 
quirements  analysis  specifies  the  degree  or  extent  of  physical  and  func¬ 
tional  equipment  similarity  required  to  achieve  satisfaction  of  the  train¬ 
ing  objectives.  They  thus  focus  on  physical  and  functional  similarities 
of  the  simulator  to  the  actual  equipment  in  defining  fidelity.  They  em¬ 
phasize  the  need  to  analyze  behavioral  tasks  in  terms  of  the  necessary 
cues  which  the  simulator  must  provide  to  enable  the  trainee  to  discrimi¬ 
nate  among  the  cues  provided  by  the  actual  equipment. 

Honevv.ull  Corporation  (1980)  does  not  attempt  to  define  fidelity. 

They  simply  assume  that  it  means  the  similarity  of  the  simulator  to  the 
actual  equipment.  They  state  that  it  is  important  to  determine  the  mini¬ 
mum  level  of  fidelity  necessary  to  train  required  tasks. 

It  can  be  easily  seen  that  these  practitioners  are  more  concerned 
with  the  development  of  equipment  rather  than  the  development  of  conceptual 
definitions.  Thoy  are  willing  to  assume  that  fidelity  somehow  deals  with 
the  physical  and  functional  similarity  between  the  simulator  and  the  actual 
equipment  and  then  to  design  their  equipment  to  be  as  similar  as  necessary 
to  train  to  criterion  levels.  This  approach  works  for  the  construction  of 
simulators. 

It  is  more  difficult  for  the  individuals  who  are  responsible  for  pro¬ 
curing  these  devices  because  they  must  be  able  to  judge  ths  output  of  the 
contractor  before  they  invest  huge  sums  of  money  to  develop  the  proposed 
training  simulators.  It  is  therefore  important  that  they  determine  their 
fidelity  requirements  before  attempting  to  evaluate  proposed  training 
simulators.  There  are  several  guidance  aids  which  attempt  to  assist  in 
this  process. 

Although  several  documents  have  been  developed  to  provide  guidance 
to  the  individuals  responsible  for  procuring  training  devices,  the  limited 
progress  in  conceptualizing  fidelity  is  still  seen.  For  example,  in  Train¬ 
ing  Device  Requirements  Guide  (1979)  ,  the  concept  of  fidelity  is  discussed 
only  in  terms  of  the  physical  similarity  of  the  displays  (cues)  and  con¬ 
trols  (responses)  between  the  s /jnulator  and  the  actual  equipment  (pp.  153- 
160) .  In  this  case,  the  term  fidelity  is  not  used.  Functional  similarity, 
which  compares  the  operator's  behavior  in  terms  of  information  flow  from 
each  display  to  the  operator  and  from  the  operator  to  each  control,  is  also 
emphasized  but  again  without  \:hc  use,  of  the  term  fidelity.  This  document 
makes  it  very  clear  that  the  nr).tsL  important  factor  is  not  the  physical  simi¬ 
larity  of  the  .imulator  "but  whether  the  operator  acts  on  the  same  amount 
of  information  in  the  same  way  in  both  operational  and  training  situations" 
(p.  157) .  A  simulator  might  be  physically  dissimilar  to  the  actual  equip¬ 
ment  (i.e.,  a  flat  panel  device)  and  still  provide  the  information  the 
trainee  requires  to  perform  ir  the  operational  setting.  This  document  pro¬ 
vides  guidelines  for  the  analysis  of  tasks  to  be  trained  and  also  for  the 
analysis  and  evaluation  of  the  simulator  in  terms  of  physical  and  functional 
similarity. 

A  similar  approach  is  taken  by  Interservice  Procedures  (1975) ,  a  TRADOC 
procedures  pamphlet.  Although  this  publication  uses  the  term  "fidelity"  in 
a  different  context  than  discus'.t-u  previously  (here  it  refers  to  how  well 
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the  actions,,  conditions,  cues,  and  standards  of  the  Job  Performance  Measures 
approximate  these  of  the  tasks) ,  it  nevertheless  acknowledges  the  importance 
of  task  analysis  in  the  development  of  training  devices.  This  pamphlet  pro¬ 
vides  guidelines  for  the  analysis  of  physical  characteristics  and  behavioral 
requirements. 

An  approach  which  avoids  the  use  of  the  concept  of  fidelity  in  the  se¬ 
lection  of  training  devices  is  the  TRAINVICE  II  model  (Swezey  &  Evans, 

1980) .  This  model  incorporates  techniques  from  both  of  the  previous  publi¬ 
cations  to  analyze  the  physical  and  functional  characteristics  of  the  train¬ 
ing  devices  and  also  the  behavioral  requirements  which  must  be  trained.  As 
with  botr.  of  the  other  guidebooks  discussed,  this  model  focuses  upon  the 
importance  of  both  the  physical  and  the  functional  characteristics  of  the 
simulator  or  other  training  device.  The  term  "fidelity"  is  not  employed 
in  this  discussion  and  it  is  not  a  comparison  of  simulator  characteristics 
with  operational  equipment  characteristics  but  rather  a  comparison  of  simu¬ 
lator  characteristics  with  learning  guidelines. 

An  additional  guidebook  for  training  device  design  was  developed  by 
Honeywell  for  the  Air  Force  Human  Resources  Laboratory  (Miller,  McAleese,  & 
Erickson,  1977) .  This  guidebook  defines  fidelity  as  "the  degree  of  cor¬ 
respondence  between  operational  and  simulation  devices  in  terms  of  cues, 
responses,  and  actions  that  can  be  performed"  (pp.  51-52).  According  to 
this  guidebook,  the  level  of  fidelity  may  be  determined  by  task  analysis. 
Tasks  are  analyzed  in  terms  of  criticality,  frequency,  and  difficulty. 

Task  statements  are  developed  and  subsequently  used  to  determine  the  neces¬ 
sary  level  of  fidelity  for  the  device  designed  to  train  the  tasks. 

One  other  publication  which  addresses  this  issue  is  provided  by  the 
Air  Force  Human  Resources  Laboratory  (Purifoy  &  Benson,  1979) .  This  model 
discusses  four  considerations  which  must  be  evaluated  when  discussing  the 
appropriate  levels  of  simulator  fidelity.  They  are  environmental  condi¬ 
tions,  stimuli,  response  situations,  and  control-display  relationships. 

In  this  guidebook,  fidelity  is  viewed  in  the  whole  training  context.  It 
is  assumed  that  fidelity  cannot  be  isolated  but  must  be  incorporated  into 
am  overall  training  requirements  analysis.  Here  we  must  not  only  deal  with 
physical  and  functional  similarity  but  also  how  similarity  levels  interact 
with  other  variables  in  the  training  situation.  A  similar  conclusion  is 
reached  by  Eddowes  &  Waag  (1980) .  They  define  fidelity  as  the  physical 
similarity  of  the  learning  environment  to  the  performance  environment  and 
feel  that  a  simulator  must  be  incorporated  into  the  total  training  context 
if  it  is  to  be  effective. 


RECOMMENDED  APPROACH  TO  FIDELITY 

Table  1  shows  the  variety  of  fidelity  terms  that  were  discussed  pre¬ 
viously.  It  can  easily  be  seen  that  many  terms  have  been  used  in  connec¬ 
tion  with  the  terra  "fidelity."  Not  only  have  many  different  terms  been 
used,  but  various  fidelity  concepts  have  been  described  with  different 
labels.  Table  2  shows  how  several  of  the  same  concepts  have  been  labeled 
with  various  terms.  Variations  in  terminology  and  multiple  labeling  of 
concepts  tend  to  confuse  the  issue,  so  it  is  important  to  realize  that  the 
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Table  1 


Varieties  of  Fidelity  Terms 


Author /publication  Fidelity  terms  used 


Kinkade  6  Wheaton  (1972) 

Wheaton,  Mirabel la,  &  Farina  (1971) 
Matheny  (1978) 

Fink  &  Shriver  (1978) 

Slenker  &  Cream  (1977) 

Freda  (1979) 

Seville  (1980) 

Grumman  (1980) 

Honeywell  (1980) 

Training  Device  Requirements 
Guide  (1979) 

Interservice  Procedures  (1975) 

Miller,  McAleese,  &  Erickson  (1977) 

Purifoy  &  Benson  (1979) 

Eddowes  &  Waag  (1980) 


Equipment  fidelity 
Environmental  fidelity 
Psychological  fidelity 

Task  fidelity 

Behavioral  fidelity 

Physical  fidelity 
Functional  fidelity 

Functional  fidelity 

Physical  fidelity 
Psychological  fidelity 

Fidelity  (total  context) 

Physical  fidelity  requirements 
Functional  fidelity  requirements 

Similarity 

Physical  similarity 
Functional  similarity 

Fidelity  of  job  performance 
measures 

Degree  of  correspondence  (cues, 
responses,  actions) 

Fidelity  (total  context) 

Physical  similarity 
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Table  2 


Overlapping  Fidelity  Concepts 


Concept 

Fidelity  terms  used 

Author /publication 

Physical 

Physical 

Fink  &  Shriver  (1978) 

fidelity 

Equipment 

Kinkade  &  Wheaton  (197?) 

Functional 

Slenker  &  Cream  (1977) 

Physical 

Freda  (1979) 

Physical 

Hughes  (1980) 

Fidelity  (context) 

Seville  (1980);  Purifoy  & 

Benson  (1979) 

Physical  requirements 

Grumman  (1980) 

Physical  similarity 

Honeywell  (1980) ;  Training  De¬ 
vice  Requirements  Guide 
(1979);  Eddowes  &  Waag  (1980) 

Physical  correspondence 

Miller,  McAleese,  6  Erickson 
(1977) 

Functional 

Functional 

Fink  &  Shriver  (1978) 

fidelity 

Environmental 

Kinkade  £  Wheaton  (1972) 

Functional 

Slenker  £  Cream  (1977) 

Psychological 

Freda  (1979) 

Fidelity  (context) 

Seville  (1980) ;  Purifoy  £ 

Benson  (1979) 

Functional  requirements 

Gruoman  (1980) 

Functional  similarity 

Honeywell  (1980) ;  Training  De¬ 
vice  Requirements  Guide 
(1979) 

Functional  correspondence 

Miller,  McAleese,  £  Erickson 
(1977) 

Behavioral 

Task  fidelity 

Wheaton,  Mirabel la,  £  Farina 
(1971) 

Behavioral  fidelity 

Matheny  (1978) 

Psychological  fidelity 

Hughes  (1980) 

Job  performance  measure 

Interservice  Procedures  (1975) 

Perceptual 

Psyche logical 

Kinkade  £  Wheaton  (1972) 

issue  is  the  acquisition  by  the  trainees  of  skills  which  they  may  use  on 
the  actual  equipment.  We  are  thus  concerned  with  behavior,  and  it  is  im¬ 
portant  that  we  not  confuse  fidelity  with  this.  Fidelity  has  been  defined 
in  terms  that  cover  the  entire  gamut  from  physical  characteristics  of  the 
training  simulator  to  the  perception  of  the  trainees  and  their  behaviors. 

In  the  opinion  of  this  author,  the  term  "fidelity"  should  be  restricted  to 
descriptions  of  the  configuration  of  the  equipment  and  not  be  used  when 
discussing  behaviors.  We  must  ultimately  measure  and  evaluate  behaviors, 
but  there  are  many  concepts  already  available  such  as  sensation,  perception, 
learning,  retention,  or  reinforcement  to  deal  with  these.  The  issue  of  fi¬ 
delity  only  becomes  muddled  if  we  attempt  to  use  the  same  term  to  cover  all 
the  various  aspects  of  the  training  situation.  This  is  not  to  say  we  should 
throw  out  the  remainder  of  the  gamut.  Rather,  we  should  use  labels  for 
these  concepts  that  do  not  confuse  them  with  fidelity. 

Of  the  approaches  discussed  above,  the  one  which  best  isolates  the 
equipment  characteristics  from  the  behaviors  of  trainees  on  the  equipment 
is  the  approach  of  Fxuk  and  Shriver  (1978).  As  was  stated  previously,  Fink 
and  Shriver  only  discuss  functional  and  physical  fidelity.  In  both  func¬ 
tional  and  physical  fidelity  we  are  concerned  with  the  equipment  on  w"hich 
training  is  to  proceed.  The  following  definition  of  fidelity  is  therefore 
proposed : 

Fidelity  is  the  degree  of  similarity  between  the  simulator  and 
the  equipment  which  is  simulated.  It  is  a  measurement  of  the  physi¬ 
cal  characteristics  of  the  simulator  (physical  fidelity)  and  the 
informational  or  stimulus  and  response  options  of  the  equipment 
(functional  fidelity) . 

With  this  restricted  use  of  the  term  fidelity  in  mind,  let  us  now  discuss 
why  the  level  of  simulator  fidelity  need  not  necessarily  be  as  high  as 
possible. 


RE '.SONS  FOR  DEPARTURE  FROM  HIGH  FIDELITY 

In  his  considerations  for  the  designs  oif  simulators,  Miller  (1974)  states 
that  studies  have  never  shown  that  high  fidelity  is  associated  with  poorer 
training.  This  statement  may  not  be  true.  In  a  study  by  the  Air  Force  (Mar¬ 
tin  &  Waag,  1978) ,  it  was  shown  that  flight  simulators  with  very  high  fidelity 
(6  degrees  of  motion)  provided  too  much  information  for  novice  trainees  and 
actually  detracted  from  simulator  efficiency.  There  are  also  other  consid¬ 
erations  which  foijce  the  designers  and  procurers  of  training  simulators  to 
desire  lower  levels  of  fidelity. 

Cox  et  al.  (1965)  studied  the  effects  of  a  wide  variety  of  fidelity 
levels  on  the  training  of  fixed-procedures  tasks.  They  concluded  that  the 
requirements  for  fidelity  are  really  quite  low  as  long  as  the  controls  and 
displays  of  the  device  remain  clearly  visible  to  the  individual  trainee  and 
as  long  as  the  functional  relations  between  parts  are  maintained.  They  are 
careful  to  state  that  these  conclusions  apply  only  in  a  fixed-procedures  task 
paradigm.  It  is  probably  safe  to  conclude  that  at  least  some  departures  from 
high  fidelity  will  not  produce  detrimental  effects  in  the  training  effective¬ 
ness  of  a  simulator  on  other  types  of  tasks.  Since  high  fidelity  is 
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associated  with  higher  simulator  cost*,  it  is  prudent  to  determine  just  how 
much  fidelity  is  necessary  in  a  training  simulator. 

Blaiwes  et  al.  (1973)  state  four  reasons  for  departure  from  perfect 
physical  fidelity.  The  first  deals  with  training  effectiveness.  It  has 
been  shown  (Martin  &  Wang,  1980)  that  it  is  contrary  to  good  ironing  prac¬ 
tice  to  make  training  an  exact  duplicate  of  certain  real  jobs.  The  train¬ 
ing  situation  affords  the  opportunity  for  immediate  feedback  and  enhanced 
stimulus  cues  which  aid  in  training  but  which  may  not  be  available  on  actual 
equipment.  Whnn  these  features  are  incorporated  in  a  simulator,  the  level 
of  fidelity  is  lowered. 

A  second  reason  is  the  cost  effectiveness  of  lower  fidelity  simulators. 
A  simulator  may  be  lass  costly  than  the  actual  equipment  and  if  it  can  be 
designed  with  a  lower  level  of  fidelity  and  still  provide  adequate  transfer 
of  training,  even  more  money  can  be  saved. 

The  third  reason  for  departure  from  perfect  fidelity  is  the  safety  of 
the  training.  It  may  be  too  dangerous  to  train  people  on  the  actual  equip¬ 
ment.  Not  only  could  individuals  be  injured  but  the  actual  equipment  may 
be  damaged  if  certain  malfunctions  are  induced  for  the  purposes  of  training. 

The  final  reason  given  by  Blaiwes  et  al.  is  the  technological  barriers 
to  duplicating  the  operational  environment.  It  may  not  always  be  possible 
to  produce  a  training  simulator  that  exhibits  perfect  fidelity.  The  level 
of  fidelity  necessary  to  produce  trained  personnel  must  be  determined  by 
accounting  not  only  for  the  previous  considerations  but  also  for  considera¬ 
tions  inherent  in  the  training  context.  Training  context  is  defined  as  the 
way  in  which  a  training  simulator  is  incorporate!  into  a  specific  program 
of  instruction.  Although  we  may  see  fidelity  as  a  central  question  in  any 
attempt  to  design  or  evaluate  a  training  simulator,  it  is  not.  The  central 
question  is  not  its  fidelity  but  its  training  effectiveness.  As  we  shall 
see,  fidelity  interacts  with  several  parameters  to  determine  training 
effectiveness. 


FIDELITY  AND  TRAINING  EFFECTIVENESS 

The  question  of  the  necessary  level  of  fidelity  has  been  asked  ever 
since  simulators  began  to  be  used  in  training.  Not  much  progress  was  made 
in  determining  fidelity  requirements  until  it  was  realized  that  fidelity 
is  not  really  the  question  at  all.  Bunker  (1978)  states  that  progress  was 
made  only  when  "instead  of  pondering  how  to  achieve  realism,  we  should  ask 
how  to  achieve  training"  (p.  291) . 

The  same  point  was  made  by  Kinkade  and  Wheaton  (J972)  several  years 
earlier.  "The  overall  level  of  fidelity  required  in  a  training  device  is 
partially  determined  by  the  desired  amount  of  transfer  of  training"  (p.  679) 

What  these  statements  tell  us  is  that  fidelity  is  not  a  concept  that 
may  be  discussed  in  isolation.  The  effect  of  fidelity  on  training  effective 
ness  is  not  simple.  It  is  modified  by  the  total  context  in  which  the  equip¬ 
ment  is  used. 


Fidelity  and  the  Training  Context 


Micheli  (1972)  makes  the  point  that  it  may  be  more  important  how  a  de¬ 
vice  is  used  than  how  it  is  designed.  Montemerlo  (1977)  states  that  the 
training  effectiveness  of  a  simulator  is  a  function  of  the  total  training 
environment  and  not  just  the  characteristics  of  a  particular  piece  of  equip¬ 
ment.  Wheaton  et  al.  (1976)  concluded  after  an  extensive  review  of  fidelity 
literature  that  fidelity  per  se  is  not  sufficient  to  predict  device  effec¬ 
tiveness  and  that  the  effect  of  fidelity  varies  as  a  function  of  the  type  of 
task  to  be  trained.  It  becomes  increasingly  clear  that  we  cannot  productively 
deal  with  the  concept  of  fidelity  in  isolation  but  rather  as  a  function  of 
total  training  context — which  includes  the  training  tasks,  the  stage  of 
learning  of  the  trainees,  and  the  instructional  system  designed  to  train  the 
tasks.  Training  effectiveness  (i.e.,  the  amount  of  transfer  of  training 
from  the  simulator  to  the  actual  equipment  in  a  specific  context)  may  be 
used  to  determine  necessary  simulator  fidelity  levels. 


Fidelity  and  Type  of  Task 

Several  authors  have  n-ade  the  point  that  we  must  define  necessary  fi¬ 
delity  levels  in  terms  of  the  tasks  which  must  be  trained.  Different  tasks 
may  require  different  levels  of  fidelity.  Fink  and  Shriver  (1978)  distin¬ 
guish  between  the  necessary  instruction  for  maintenance  tasks  versus  that 
needed  for  operational  tasks.  Maintenance  training  should  entail  "instruc¬ 
tion  in  decision  processes  to  a  greater  degree  than  operations  training. 

This  instruction  must  include  formulation  of  decision  rules,  identification 
of  decision  alternatives,  and  actual  decision  making"  (p.  5) .  The  fidelity 
level  necessary  for  decision  making  may  be  very  different  thar  that  neces¬ 
sary  for  operating  the  controls  on  a  piece  of  equipment.  The  important  point 
here  is  that  we  are  attempting  to  train  individuals  to  behave  in  certain 
ways  and  that  the  ultimate  behaviors  must  guide  our  choice  of  fidelity 
levels.  Miller  (1980)  states  the  point  in  this  way: 

While  physical  identity  of  operational  and  training  equipment  does 
facilitate  transfer,  the  controlling  factor  is  not  physical  con¬ 
gruence  but  the  (sometimes  subtle)  cues  that  guide  the  behavior 
involved  in  the  performance  of  a  task.  Careful  analysis  and  ex¬ 
ploitation  of  thesa  cue/behavior  patterns  is  the  basis  of  all  syn¬ 
thetic  or  simulation-based  approaches  to  training  (p.  5) . 

Stated  another  way,  "The  important  point  is  that  the  behavioral  re¬ 
quirements  dictate  the  physical  chaj;acteristics  rather  than  some  perceived 
physical  fidelity  dictating  behavior"  (Matheny,  .1978,  p.  4)  . 

What  is  necessary  is  for  us  to  bridge  the  gap  between  the  output  be¬ 
haviors  which  we  desire  and  the  input  behaviors  which  the  trainees  arrive 
with. 


Fidelity  and  Stage  of  learning 

&n  important  consideration  in  determining  the  fidelity  levels  necessary 
to  build  this  "behavioral  bridge"  is  the  stage  of  learning  in  which  we  find 
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the  tra_nee„  Fink  and  Shriver  (1978)  discuss  tour  stages  of  learning  of 
which  each  has  different  general  training  objectives  and  which  lend  them¬ 
selves  to  the  use  of  different  types  of  training  devices  with  different 
levels  of  fidelity.  Table  3  shows  these  stages  of  learning  and  their 
relationship  to  training  objectives  and  types  of  training  devices.  Fink 
and  Shriver  are  of  the  opinion  that  "no  one  class  of  training  aid  or  de¬ 
vices  need  carry  the  entire  training  load"  (p.  22) .  They  feel  it  is  more 
cost  effective  to  train  the  first  scages  of  learning  on  low  fidelity  de¬ 
vices  before  switchino  to  more  expensive  simulators  required  in  later 
learning  stages.  Kinkade  and  Wheaton  (1972)  make  the  same  point.  They 
delineate  five  stages  of  training  for  which  different  training  devices  are 
appropriate.  Table  4  shows  the  types  of  training  devices  associated  with 
these  five  stages  of  training. 


Fidelity  and  Task  Analysis 

We  can  see  that  fidelity  levels  carutot  be  determined  outside  of  the 
training  context.  The  determination  of  the  necessary  fidelity  becomes  a 
repetitive  process  with  the  analysis  of  tasks  and  behavior  objectives  as 
its  guiding  principles.  "The  major  decisions  in  this  process  are  selec¬ 
tion  of  the  subset  of  tasks  that  will  actually  be  trained  in  the  device  and 
deters ination  of  the  degree  of  fidelity  necessary  to  train  each  of  the  tasks 
in  the  subset"  (Eggemeir  &  Cream,  1978,  p.  18).  Task  analysis  therefore  is 
the  important  first  step  in  determining  not  only  fidelity  requirements  but 
also  whether  a  simulator  is  necessary  at  all. 

Tasks  have  been  analyzed  in  various  ways.  Smode  (1971)  analyzes  tasks 
as  training  objectives:  what  is  to  be  trained,  under  what  conditions  the 
training  will  occur,  and  the  standard  of  performance  desired  at  the  end  of 
training.  For  each  objective,  tasks  are  stated  in  terms  of  performance 
elements,  how  these  will  he  measured  and  the  conditions  under  which  per¬ 
formance  occurs.  Smode  provides  a  detailed  strategy  for  developing  these 
training  objectives.  Similar  strategies  are  provided  in  the  guidebooks 
which  were  discussed  above  ( Interservice  Procedures,  1975;  Lenzychi  &  Fin¬ 
ley,  1980;  Training  Device  Requirements  Guide,  1979). 

Another  approach  to  task  analysis  is  to  rank  each  task  in  terms  of 
its  criticality,  frequency,  and  difficulty  (CFD)  (Slenker  &  Cream,  1977; 
Eggemeir  &  Cream,  1978;  Freda,  1979).  Tasks  that  are  rated  high  on  these 
dimensions  vould  be  included  in  the  training  device  with  the  fidelity  level 
determined  by  a  repetitive  process.  Freda  (1979)  also  uses  the  CFD  approach 
to  provice  a  framework  for  analyzing  learning  -tasks  in  terms  of  the  infor¬ 
mation  processing  demands  on  the  individual  in  the  operational  setting. 
"These  information  processing  demands  can  be  viewed  as  a  sequential  flow 
of  three  information  processing  stages"  (p.  6) . 

The  first  stage  is  sensory  input  and  "refers  to  the  degree  of  CFD  in¬ 
volved  in  the  apprehension  of  operational  stimulus  parameters  for  supra- 
threshold  input  processing"  (p.  9) .  The  second  stage  is  central  processing 
and  "refers  to  the  degree  of  CFD  involved  in  using  cognitive  skills  and 
strategies  for  selecting  the  appropriate  psychomotor  output  based  on  the 
sensory  input"  (p.  9) .  The  third  stage  is  psychomotor  output  and  "refers 
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Table  3 


General  Relationship  Between  Stages  of  learning.  Training  Objectives, 
and  Types  of  Training  Devices  (Fink  &  Shriver,  197Q,  p.  23) 


Stages  of 
learning 

General  training 
objectives 

Types  of  training  devices 

1st  stage 

Acquire  enabling  skills 
and  knowledges 

Demonstrators — wall  charts, 
films,  TV,  mock-ups,  etc. 
Nomenclature  &  parts  location 
Trainers 

2nd  stage 

Acquire  uncoordinated 
skills  and  unapplied 
knowledges 

Part-task  trainers 

Procedures  trainers 

3rd  stage 

Acquire  coordi'  - „ed 
skills  and  ability  to 
apply  knowlev»ges 

Trouble shooting  logic  trainers 
Job  segment  trainers 

Skills  trainers 

4th  stage 

Acquire  job  proficiency 
in  job  setting 

Operational  equipment 

Actual  equipment  trainers 

Table  4  • 

Types  of  Training  Devices  Associated  with  Stages  of  Learning 
(adapted  from  Kinkade  &  Wheaton,  1972,  p.  673) 

Stages  of 
learning 

Types  of  training  devices 

Indoctrination 

Filins,  TV,  mockup 

Procedura 1 

training 

Photographs,  nonfunctional  mockup, 
functional  mockup 

Familiarization  training 

Functional  equipment 

Part -task  trainer 

Skill  training 

Functional  with  mem-machine  dynamics 
Represented 

Part-task  trainer 

Transition 

training 

Part- task  simulator 

to  the  degree  of  CFD  involved  in  the  expression  of  the  appropriate  beha¬ 
vioral  response"  (p.  9)  > 

Depending  upon  the  stage  of  the  information  processing  demands  in 
which  a  given  task  is  classified  and  depending  upon  its  CFD  rating,  the 
fidelity  requirements  of  a  simulator  to  train  that  task  may  be  determined 
(Freda,  1979;  Lenzychi  &  Finley,  1980). 

An  alternative  (or  perhaps  complementary)  approach  to  task  analysis 
is  to  analyze  the  behavioral  cues  which  stimulate  the  required  performance 
(Pearson  &  Moore,  1978;  Grumman,  1980).  In  this  approach,  the  degree  of 
fidelity  necessary  in  the  simulator  is  determined  on  the  basis  of  the 
amount  of  information  the  students  must  derive  from  the  cue  to  make  the 
c\ie  worthwhile.  "The  desired  fidelity  of  a  given  cue  is  that  level  which 
will  enable  a  trainee  discrimination  equivalent  to  that  which  he  could  ob¬ 
tain  from  that  cue  and  similar  cues  provided  by  the  operational  equipment" 
(Grumman,  1980,  p.  128) .  This  approach  would  make  a  useful  addition  to  the 
approach  discussed  above  where  tasks  are  analyzed  in  terms  of  CFD.  Once  it 
is  determined  that  a  given  task  is  above  the  criterion  level  on  CFD,  it  may 
then  be  analyzed  in  terms  of  its  behavioral  cues  to  determine  the  necessary 
level  of  fidelity  to  train  the  task. 


Fidelity  and  the  Trainee's  Abilities 

An  important  area  of  research  which  relates  to  task  analysis  is  the 
determination  of  how  the  skills  which  are  necessary  for  a  given  task  relate 
to  general  abilities.  This  relationship  has  been  utilized  in  rating  tasks 
on  CFD  (Freda,  1979) .  Tasks  have  been  organized  into  11  general  categories 
which  are  very  close  to  general  abilities  (Aagard  a  Braby,  1976).  Not  only 
can  these  general  learning  categories  be  used  to  evaluate  tasks  in  deter¬ 
mining  necessary  fidelity  levels,  but  it  is  also  possible  to  use  the  output 
from  such  evaluations  to  determine  which  individuals  should  be  selected  for 
training  in  the  first  place.  By  testing  individuals  on  basic  abilities 
prior  to  their  inclusion  in  training  programs,  it  should  be  possible  to 
screen  out  those  trainees  who  do  not  possess  the  required  abilities  to 
benefit  from  a  given  training  program.  Again,  we  must  keep  in  mind  that 
the  issue  of  fidelity  should  be  secondary  to  the  real  issue,  which  is  the 
production  of  well  trained  personnel.  The  "best"  training  course  with 
perfect  fidelity  levels  will  not  be  productive  if  the  trainees  selected 
for  the  course  do  not  have  the  requisite  abilities  to  master  the  tasks 
trained  in  the  course. 


Fidelity  and  Psychological  Principles 

The  determination  of  the  necessary  fidelity  level  for  a  training  simu¬ 
lator  may  be  facilitated  if  we  are  guided  by  established  psychological 
principles  in  the  design  of  the  simulator.  Adams  (1979)  discusses  five 
psychological  principles  which  should  underlie  the  design  and  use  of  any 
simulator.  These  principles  are  (1)  human  learning  is  dependent  on  knowledge 
of  results  (KOR)  so  any  simulator  should  incorporate  KOR,  (2)  perceptual 
learning  or  the  ability  to  extract  information  from  stimulus  patterns  in¬ 
creases  as  a  result  of  experience  which  may  be  provided  on  a  simulator. 
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(3)  if  a  response  is  to  be  made  to  a  stimulus,  then  the  stimulus  and  the 
control  for  response  to  it  must  be  in  the  simulator,,  (4)  transfer  is  high¬ 
est  when  the  similarity  between  the  simulator  and  the  actual  equipment  is 
high  although  transfer  is  possible  with  low  similarity,  and  (5)  the  trainee 
must  be  motivated  if  learning  is  to  occur.  One  additional  principle  (Grum¬ 
man,  1980)  is  relevant.  It  is  the  phenomenon  of  perceptual  constancy. 

This  phenomenon  occurs  when  familiar  objects  are  perceived  us  maintaining 
their  perceived  characteristics  almost  independent  of  changes  in  stimulus 
conditions.  This  principle  allows  reduced  fidelity  in  simulators  to  a 
certain  point.  Each  of  these  principles  should  be  taken  into  account  when 
the  fidelity  levels  of  a  simulator  are  determined.. 


Training  Effectiveness  as  Determinant  of  Fidelity  Requirements 

As  was  stated  previously,  training,  rather  them  fidelity,  is  the  real 
issue.  We  are  in  the  business  of  training  individuals  in  specific  tasks 
and  all  the  hardware  and  software  are  simply  aids  in  this  training  process. 
The  necessary  fidelity  level  becomes  easier  to  determine  by  using  training 
effectiveness  as  our  criterion.  The  necessary  fidelity  level  for  a  given 
simulator  may  be  empirically  determined  by  the  training  effectiveness  of 
the  simulator.  As  stated  previously,  training  effectiveness  may  be  opera¬ 
tionalized  as  the  amount  of  transfer  of  training  from  the  simulator  to  the 
actual  equipment.  However,  this  method  has  problems  as  pointed  out  by 
Adams  (1979) .  The  most  critical  problem  is  the  cost  of  transfer  of  train¬ 
ing  experiments.  It  would  be  very  costly  to  design  several  simulators 
with  different  levels  of  fidelity,  train  individuals  on  them,  and  then 
evaluate  the  trainee's  performance  on  actual  equipment.  However,  this  is 
the  only  method  that  will  provide  us  with  the  empirical  data  necessary  to 
determine  fidelity  requirements.  It  may  be  possible  to  make  this  method 
more  cost  effective  by  limiting  the  number  of  fidelity  levels  evaluated 
and  by  beginning  our  investigations  with  lower  levels  of  fidelity.  As  Fink 
and  Shriver  (1978)  wrote:  "The  answer  to  maintenance  training  lies  not  in 
how  much  but  how  little  simulation  to  use.  This  is  not  to  say  that  fewer 
simulators  should  be  used,  merely  that  low-cost,  low-fidelity  simulators 
should  be  employed  where  they  can  be  made  effective"  (p.  26) .  Eddowes 
(1978)  also  said:  "As  soon  as  the  capabilities  of  a  simulator  support 
practice  of  a  set  of  training  tasks,  stop  adding  to  it.  Everything  else 
the  simulator  does  will  cost  more,  and  while  it  may  not  detract  from  train¬ 
ing  effectiveness,  it  probably  won't  add  to  it"  (p.  53) .  Once  we  have  de¬ 
termined  that  a  lower  fidelity  level  is  adequate  for  a  given  simulator,  it 
will  not  be  necessary  to  evaluate  simulators  which  incorporate  higher  fi¬ 
delity  levels.  Let  us  now  discuss  some  of  the  methodological  issues  in¬ 
volved  in  empirically  determining  necessary  levels  of  simulator  fidelity. 


METHODOLOGICAL  ISSUES 

Several  methodological  issues  arise  when  we  attempt  to  empirically  de¬ 
termine  the  necessary  fidelity  level  for  a  simulator  to  train  a  given  task. 
As  was  discussed  earlier,  various  tasks  will  require  different  levels  of 
fidelity  as  will  different  stages  of  the  learning  process.  It  is  important 
that  general  guidelines  be  established  for  required  fidelity  levels  and  the 
only  way  to  establish  these  guidelines  is  through  empirical  investigations 
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of  the  relationship  between  level  of  fidelity  and  training  effectiveness. 
These  ompiric?il  investigations  should  begin  at  a  general  level  and  proceed 
to  a  mere  specific  level.  The  studie?  <„t  the  general  level  may  be  consid¬ 
ered  pilot  studies  which  will  direct  later  investigations  focusing  on  spe¬ 
cific  tasks  and  specific  configurations  of  training  simulators. 

The  first  step  in  the  empirical  investigation  of  che  relationship  be¬ 
tween.  level  of  fidelity  and  training  effectiveness  i?  to  develop  a  scale 
to  measure  level  of  fidelity.  If  we  follow  the  definition  of  fidelity  that 
wa?.  developed  previously,  we  will  ht\ve  two  factors  to  measure:  the  physi¬ 
cal  characteristics  of  the  simulator  (physical  fidelity)  and  the  informa¬ 
tional  or  stimulus  and  response  options  of  the  equipment  (functional 
fidelity) . 

We  therefore  need  to  measure  the  physical  and  functional  aspects  of 
fidelity  before  we  can  attempt  to  empirically  determine  how  these  factors 
relate  to  the  training  effectiveness  of  the  simulator.  An  example  of  this 
two-faocor  approach  to  the  measurement  of  fidelity  in  the  work  of  Wheaton, 
Mj.rabella,  and  Farina  (1071),  Wheaton  and  Mirab&lla  (1972),  and  Mirabel  la 
ard  Wheaton  (1974).  In  these  three  investigations,  two  scales  were  used  to 
measure  the  characteristics  of  training  simulators.  Panel  lay-out  indexes 
developed  by  Fowler  ,  Williams,  Fowier,  and  Young  (!!9SS^  were  used  to  measure 
the  physical  fidelity  of  the  simulators.  Another  scale  which  was  assumed  to 
vary  independently  with  the  above  scale  was  used  to  measure  the  functional 
fidelity  of  the  simulators.  This  scale,  called  the  Display  Evaluative  Index 
(DEI)  w?*s  developed  by  Siegel,  Miehle,  and  Fedennan  (1962)  and  is  a  measure 
of  the  effectiveness  with  which  information  flows  from  displays  to  corre¬ 
sponding  controls  via  the  operator.  This  approach  yi aids  two  fidelity  mea¬ 
sures  which  define  the  two  aspects  of  fidelity.  Depending  on  other  param¬ 
eters  such  as  task  type  and  level  of  training,  these  at poets  would  interact 
and  lead  to  a  given  level  of  training  effectiveness. 

An  example  of  the  design  for  one  of  these  pilot  stuoies  is  shown  in 
Figure  1.  Here  we  see  the  two  aspects  of  fidelity  (physical  and  functional) 
being  treated  as  factors  in  a  3  x  3  factoral  design.  Depending  on  how  a 
fidelity  factor  fell  on  the  measurement  scale  chosen  for  the  experiment, 
each  factor  would  be  represented  as  low,  medium,  or  high.  Values  in  the 
cells  of  the  design  would  be  derived  from  measures  of  proficiency  on  the 
actual  equipment. 

The  measurement  of  training  effectiveness  is  another  problem  which 
must  be  solved  if  our  empirical  investigations  are  to  be  meaningful.  While 
there  are  a  variety  of  methodologies  and  measures  that  have  been  used  to 
measure  the  training  effectiveness  of  simulators,  the  transfer  of  training 
experiment  is  the  most  useful  for  experimental  purposes  (Adams,  1979).  Of 
the  various  measures  of  training  effectiveness  that  may  be  derived  from  a 
transfer  of  training  experiment,  the  transfer  effectiveness  ratio  (Proven- 
mire  a  Roscoe,  1971)  may  be  best  adapted  for  this  research.  It  has  been 
used  successfully  in  Army  simulator  effectiveness  research  (Holman,  1979) . 
The  transfer  of  a  training  type  of  study  would  have  to  be  applied  to  each 
training  task  to  determine  the  "best"  combination  of  physical  and  func¬ 
tional  fidelity  for  that  task.  A  review  of  theories  and  models  of  trans¬ 
fer  of  training  is  provided  by  Wheaton  et  al.  (1976) . 
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Physical  fidelity 


Lo.i  Medium  High 

(control  absent)  (drawing)  (3-D) 


Functional 

fidelity 


Low 

(dcesn 1 t  work 
mechanically) 


Medium 
(works  with 
no  effect) 


High 

(works  with 
effect) 


Figure  1.  Sample  design  for  a  pilot  study  to  determine  the  "best" 
combination  of  fidelity  levels  for  a  given  task. 
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Once  such  pilot  studies  have  narrowed  our  focus  down  to  a  few  testable 
concepts,  we  may  develop  training  programs  which  actually  use  simulators  to 
train  individuals.  Then  we  can  measure  the  level  of  training  effectiveness 
on  a  given  task.  Our  research  efforts  should  determine  the  training  effec¬ 
tiveness  of  every  type  of  fidelity  configuration.  Data  from  these  efforts 
may  then  be  used  to  determine  which  configuration  is  most  cost  effective  to 
produce  the  highest  level  of  training  effectiveness  on  a  given  task.  If 
lower  levels  of  fidelity  produce  adequate  training  effectiveness,  then  there 
is  no  necessity  to  produce  simulators  with  higher  fidelity.  As  was  stated 
previously,  more  fidelity  than  is  necessary  may  not  reduce  the  efficiency  of 
a  simulator  but  it  will  probably  not  improve  it  either.  Just  enough  fidelity 
to  motivate  the  trainee  while  providing  him  or  her  with  the  necessary  skills 
on  the  actual  equipment  is  the  goal  to  which  we  should  strive.  In  this  way 
we  still  provide  the  most  cost  effective  training  for  the  Army's  personnel. 


CONCLUSIONS  AND  RECOMMENDATIONS 

Confusion  surrounding  the  use  of  the  term  "fidelity"  may  be  substan¬ 
tially  reduced  if  we  limit  the  use  of  the  term  ar.d  let  fidelity  refer  only 
to  the  degree  of  similarity,  both  physical  and  functional,  between  a  train¬ 
ing  device  and  the  actual  equipment  for  which  the  training  was  undertaken. 

By  dealing  with  the  configuration  of  the  equipment  itself,  we  have  something 
concrete  which  we  can  manipulate  to  change  the  trainee’s  behaviors.  Other 
concepts  which  have  been  discussed  under  the  label  "fidelity"  are  still  use¬ 
ful  but  should  be  separated  from  the  concept  of  fidelity  by  the  use  of  other 
labels.  We  may  then  ask  how  fidelity  interacts  with  these  concepts.  Many 
researcheru  have  concluded  that  fidelity,  as  defined  in  this  paper,  inter¬ 
acts  with  at  least  four  factors:  the  stage  *;>f  learning  of  the  trainee,  the 
type  of  task  to  be  trained  and  the  way  the  simulator  is  used  and  accepted 
by  students  and  instructors,  and  the  individual  sensory  and  perceptual  dif¬ 
ferences  among  subpopulations  of  trainees.  Further  research  needs  to  be 
conducted  to  at  least  generally  determine  how  the  above  factors  actually 
interact  with  the  physical  and  functional  configuration  of  training  simu¬ 
lators  in  producing  given  amounts  of  trams fer  of  training.  Knowledge  about 
the  interaction  of  these  factors  with  physical  and  functional  fidelity  will 
allow  us  to  determine  the  principles  of  simulator  training  which  produce 
the  most  effective  training  program  for  any  given  task.  Once  these  prin¬ 
ciples  are  quantified  we  will  then  be  able  to  determine  not  only  the  most 
effective  simulator  configuration  but  also  the  training  context  in  which 
the  simulator  may  be  used  most  effectively. 

The  proposed  definition  of  fidelity  and  the  research  strategy  which 
uses  this  definition  should  enable  us  to  quantify  the  concept  of  simulator 
fidelity  for  any  given  task.  We  may  then  use  this  data  as  one  source  of 
input  to  our  efforts  to  prescribe  simulator  device  characteristics  for  de¬ 
vices  not  yet  produced  and  also  to  predict  the  training  effectiveness  of 
devices  that  already  exist.  Our  efforts  will  pay  off  in  more  cost  effec¬ 
tive  programs  of  instruction  which  better  train  individuals  for  the  needs 
of  the  Army. 
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